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Jakob Lange 1 Abstract: This article presents a late-stage formative usability study of a pen-injector platform 

Philipp Richard 1 device. Such devices are used for the subcutaneous delivery of biopharmaceuticals, primarily 

Nick Bradley 2 f° r self-administration by the patient. The study was conducted with a broad user population, 

. . _ _ , „ defined to represent user characteristics across a range of indications. The goals of the study 

'Ypsomed AG, Burgdorf, Switzerland; 

2 Bergo, Glasgow, United Kingdom were to confirm that the pen could be used without recurring patterns of use errors leading to 

hazardous situations, to evaluate the comprehension of the instructions for use (IFU), and to 
determine if training is necessary. In the study, a total of 36 participants in six groups (health 
care providers, caregivers, adolescents, diabetics with retinopathy, diabetics with neuropathy, 
and patients with arthritis) each read the IFU, prepared the device, and performed two simulated 
injections into an injection pad. Any use errors, near misses, or deviations from the IFU procedure 
were recorded. The overall success rate (injection completed by the participant without need 
for assistance) was 94% for the first and 100% for the second injection. Ninety-two percent of 
the participants reported that they felt confident using the device, 100% found the IFU helpful, 
and 75% found the device positively comfortable to use. Overall, a total average of 3.35 devia- 
tions and errors per user and injection were recorded (there were no near misses). Subtracting 
the errors without any potential for negative consequences for the injection or the user (trivial 
deviations), as well as those related to attaching and removing the pen needle (independent of 
the design of the pen itself), led to an average of 1 .3 1 potentially relevant deviations per user 
and injection. It was concluded that the pen injector together with the IFU could be safely and 
efficiently used by all user groups without any training, and thus that the device and IFU in their 
current form are well suited for use in a range of specific applications. 
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Introduction 

Pen injectors are used for the subcutaneous delivery of biopharmaceuticals, primarily 
for self-administration by the patient. First developed to replace vials and syringes 
for the treatment of diabetes with insulin, such injection devices have been an impor- 
tant part of the drug-delivery device family for several decades. 1 The combination 
of the worldwide increase in diabetes, the trend toward biological drugs that cannot 
be administered orally, and the growing pressure on health care costs that pushes 
toward patient self-injection means that their importance is expected to grow further 
in the future. 2 ^ 

Usability, or human-factor engineering, refers to the application of knowledge 
of human capabilities and limitations to the development and design of artifacts 
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and systems. Successful development of safe and reliable 
medical devices requires the application of usability methods 
throughout the design cycle, and documented usability testing 
is an important part of the information required by regula- 
tory authorities in order to grant marketing authorization. 5-7 
Usability evaluation during device development is typically 
divided into three parts. First comes early formative testing, 
conducted in the early development stages with the aim of 
providing feedback from users at various stages of the design 
process, in order to iteratively refine the design, the packaging 
and its instructions for use (IFU). This is followed by late- 
stage formative testing carried out to gain certainty that the 
device is suitable and likely to pass design validation. Last 
comes summative testing, performed at the end of develop- 
ment, in order to provide objective evidence that the intended 
use has been met and that the device can be safely and reliably 
used by the intended patient population. 8 

Recently, there has been a move from indication-specific 
device development (mainly for diabetes) to device platforms 
intended to be used across a wide range of therapies and 
indications. 9 " 11 This requires a different approach to forma- 
tive usability work involving user groups with a broader 
range of user properties and raises the question of how to 
set up a usability-engineering program in line with regulat- 
ing agencies' expectations without a known specific user 
population. One possibility here, and the one selected for the 
platform examined in the current study, is to adopt a two- 
tiered approach whereby the platform device first undergoes 
formative testing with a broad user population recruited to 
reflect general user properties rather than those of a specific 
indication. In a second step, the device is then customized 
for a given application and subjected to further formative 
testing, followed by design validation with the corresponding 
specific user population. 

Most of the usability work on pen injectors found in the 
literature has been studies comparing different devices for 
a specific indication and focusing on patient preference and 
ease of use. 12 " 19 Some formal summative testing of a given 
device across the intended user groups in the selected indi- 
cation has also been reported. 20 - 21 With regard to formative 
testing with the intent of identifying potential hazards and 
providing design input, only limited work on pen injectors 
can be found in the literature. 1415 To our knowledge, no stud- 
ies involving users selected to be applicable across different 
indications have been published. 

This article presents a late-stage formative study of 
a platform device with a broad user population, denned 
to represent user properties across a range of indications. 



Specifically, the study was designed and carried out with 
the goal of understanding whether the platform device and 
its IFU are suitable for users in all intended applications, 
and whether the device would be likely to pass summative 
usability tests in specific indications. 

Materials and methods 

Objectives 

In this late-stage formative study, the aim was to test the 
UnoPen™'s (YpsomedAG, Burgdorf, Switzerland) platform- 
prototype devices as well as the IFU with a sample of users 
having a variety of properties, in order to understand whether 
the device and the IFU are appropriate for a wide range of 
potential user populations. 

The primary goal of the study was to confirm that the 
UnoPen™ can be used by a user population exhibiting differ- 
ent properties without recurring patterns of use errors leading 
to hazardous situations. The secondary goal was to under- 
stand the comprehension of the IFU and gather insight about 
how the IFU can be improved. Additionally, it is expected that 
the results of the study may provide information on whether 
training needs to be considered. 

Study device 

The UnoPen™ is a disposable multiple variable-dose pen 
injector holding a 3 mL cartridge. The device is fully manual 
and similar in design to current insulin pen injectors on the 
market. It is presented in Figure 1 . The UnoPen™ operates 
according to the principles of dial to dose and push to inject. 1 
It is designed for ease of use, with a geared dosing mechanism 
providing reduced injection force and a dose scale with large, 
easy-to-read numbering. 22 - 23 

Participants and groups 

The UnoPen™ is intended as a platform device to be 
employed across different medical indications and patient 
groups. Therefore, no specific indication was used to define 
the user groups. The focus was instead on selecting relevant 
user properties that can reasonably be expected to be found 




Figure I The UnoPen™ (Ypsomed AG, Burgdorf, Switzerland) disposable pen 
injector used in the study. 
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in a wide range of applications. Ideally, any user population 
for subsequent products would be a subset of the user groups 
thus defined. 

Table 1 presents the six defined user groups, together 
with the screening criteria for each group. The different user 
groups reflect possible differences in the abilities of potential 
end users. Therefore health care providers (HCPs) in group 1 
have clinical knowledge and training, which will positively 
affect their performance with the device in comparison to lay 
users (groups 2-6). Caregivers (CGs) in group 2 will have 
full command of their mental and physical abilities; there- 
fore, they are likely to perform better than participants with 
impairments in groups 4-6. Further, as CGs inject the drug 
into someone else, the role type is different in comparison 
to other lay users who self-inject. 

Due to developmental and educational factors, which may 
affect their abilities in understanding device use, adolescents 
were assigned to a separate group (group 3). Diabetics with 



Table I Definition of the user groups and screening criteria for 
each group 



Group Definition 

(abbreviation) 



Screening criteria and target 
composition 



Health care 
professionals (HCPs) 
Caregivers (CGs) 



Adolescents (ADs) 



Diabetics with 
retinopathy (DR) 



Diabetics with 
neuropathy (DN) 



Patients with 
arthritis (AR) 



All registered diabetes specialist nurses 

People who perform injections for 
patients who are too young or patients 
who have severe conditions relating to 
groups 4-6 

People with full command of their 
physical and mental abilities and who are 
deemed to be healthy and fit to provide 
assistance to person receiving drug 
Two people naive to self-injection 
devices; remainder with varying degrees 
of experience 

Spread of participants between 1 2 and 
1 8 years of age 

Two people naive to self-injection 
devices; remainder with varying 
degrees of experience 
Spread of participants between 1 8 and 
70 years of age 

Participants with varying degrees of 
experience with self-injection devices 
Spread of participants between 1 8 and 
70 years of age 

Participants with varying degrees of 
experience with self-injection devices 
Two people naive to self-injection 
devices; remainder with varying 
degrees of experience 



Notes: These criteria were used in the recruitment process. The actual composition 
of the user groups as recruited may nevertheless be somewhat different. 



retinopathy (DR; group 4), diabetics with neuropathy (DN; 
group 5) and arthritic patients (AR; group 6) were also sepa- 
rated into distinct groups based on the type of impairment. 
Here, participants in group 4 will have visual impairments, 
participants in group 5 will have tactile impairments, and 
participants in group 6 will have motor impairments. Each 
of these groups therefore may present different challenges 
for user-interface design. 

It is currently recommended to have five to eight par- 
ticipants per user group for formative studies. 5 The target 
number of participants to be recruited was therefore set to 
eight per user group, with the aim of reaching a minimum 
of five active participants per user group. 

Facilities and equipment 

Usability tests were conducted partially in a specialized 
center at Napier University in Edinburgh, United Kingdom 
and partially at a market-research facility (Progressive 
Partnerships) in Glasgow, United Kingdom. Mannequins, 
present at the Edinburgh facility, were used for the injections 
performed by user groups 1 and 2, whereas groups 3, 4, and 
5 injected into a pad (Ypsomed AG) used at both facilities. 
The equipment used for the injections was the UnoPen™ 
disposable pen injector with water- filled cartridges as well 
as pen needles (mylife Clickfme*; Ypsomed AG). 

Procedure 

The market-research agency recruited participants across 
the six groups according to the screening criteria defined 
in Table 1. The participants were scheduled to attend an 
individual 60-minute session. The activities carried out 
by each participant were 1) read and sign a consent form, 

2) listen to background information and study brief, and 

3) conduct the handling tests. The sequence of events dur- 
ing the handling tests is depicted in Figure 2. All activities 
were accompanied by a researcher who noted results and 
observations. The handling tests were recorded on video. 

As shown in Figure 2, after participants read the IFU, they 
were asked to perform the first of two injections (performing 
all steps in the IFU), which involved either injecting 60 units 
(to simulate a large injection) or 20 units (to simulate a small 
injection). In a random fashion, half of participants across all 
groups were asked to do a 60-unit injection first, and the other 
half were asked to do a 20-unit injection first. Participants were 
allowed to refer to the IFU at any time, but did not receive any 
training on device use. The researcher observed and recorded all 
use errors, near misses, or deviations from the IFU procedure. 
Once the participant completed the last step (needle disposal), 
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Read IFU 



I 



Injection 1 
Attach needle 

Prime 
Select dose 
Inject 
Hold 

Dispose of needle 



Distractor task 



Injection 2 
Attach needle 

Prime 
Select dose 
Inject 
Hold 

Dispose of needle 



Interview 



Questions on 
injection 1 



Questions on 
injection 2 



I 



Specific 
questions 



Figure 2 Sequence of events during the handling tests. 
Abbreviation: IFU, instructions for use. 



they were asked questions on any use errors, near misses, or 
deviations identified by the researcher or any difficulties they 
experienced in understanding or using the device and/or IFU. 

Before performing the second injection, participants were 
asked to watch a 1 -minute news summary. The purpose of 
this distractor task was to minimize short-term memory recall 



from the previous injection. The second injection was then 
performed, and the same questions were asked as before. 
Participants were again allowed to refer to the IFU at any 
time. Once the questions on the second injection had been 
answered, the participants were asked a specific set of ques- 
tions and asked to rate their confidence and comfort in using 
the device as well as the helpfulness of the IFU 

Results 

Participants 

The characteristics of the participants in the study are pre- 
sented in Table 2. A total of 43 participants were recruited, 
of whom 36 participated in the study. The minimum number 
of five participants per group was reached in five of the six 
groups. Overall, 78% of the participants were female, 81% 
had previous experience using pen injectors, and 28% suf- 
fered from some kind of impairment. Thirty-three sessions 
were conducted in the center in Edinburgh, and three sessions 
conducted in Glasgow. 

Injection success rate, confidence, 
comfort, and IFU usefulness 

All participants except two persons in the AR group were 
successful (ie, required no assistance) in performing the 
first injection, which corresponded to a 94% success rate. 
Everybody succeeded in performing the second injection, 
meaning a success rate of 100% for this injection. The 
detailed results are given in Table 3. 

Table 4 presents the data on confidence in using the 
device. Overall, 69% of the participants reported that they 
would strongly agree with the statement that they felt confi- 
dent in using the UnoPen™, whereas 22% reported that they 



Table 2 Characteristics of participants 



Group 


n 


Sex 




Age, years 




Handedness 


Pen experience 


Self-reported impairments 


1 . Health care 


7 


7 female, 


0 male 


32-51, 


mean 


42 


0 left-handed, 


0 naive, 


None 


Professionals (HCPs) 














7 right-handed 


7 experienced 




2. Caregivers (CGs) 


5 


4 female, 


1 male 


19^6, 


mean 


39 


0 left-handed, 
5 right-handed 


0 naive, 

5 experienced 


None 


3. Adolescents (ADs) 


8 


6 female, 


2 male 


10-17, 


mean 


15 


2 left-handed, 
6 right-handed 


0 naive, 

8 experienced 


None 


4. Diabetics with 


5 


3 female, 


2 male 


25-66, 


mean 


41 


0 left-handed, 


1 naive, 


All reported some degree of blurriness 


retinopathy (DR) 














5 right-handed 


4 experienced 


of vision in one or both eyes 


5. Diabetics with 


4 


3 female, 


1 male 


35-57, 


mean 


47 


1 left-handed, 


1 naive, 


1 with numbness in hands, 1 with 


neuropathy (DN) 














3 right-handed 


3 experienced 


throbbing in hands, 2 without any 
impairments 


6. Patients with 


7 


5 female, 


1 male 


60-77, 


mean 


66 


3 left-handed, 


5 naive, 


4 with soreness or pain in hands, 


arthritis (AR) 














4 right-handed 


2 experienced 


3 without any impairments 


Overall 


36 


28 female, 8 male 


10-77, 


mean 


41 


6 left-handed, 


7 naive, 


10 with impairments, 26 without 
















30 right-handed 


29 experienced 
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Table 3 Observed injection success rates for the first and second injections, per user group, n (%) 





HCPs (n=7 


CGs (n=S for 


ADs (n=8 


DR (n=5 


DN (n=4 


AR (n=7 


Total (n=36 for 




for both 


1 st and n=4 for 


for both 


for both 


for both 


for both 


first and n=35 for 




injections) 


2nd injection) 


injections) 


injections) 


injections) 


injections) 


second injection) 


First injection 


7 (100%) 


S (100%) 


8 (100%) 


5 (100%) 


4 (100%) 


5 (71%) 


34 (94%) 


Second injection 


7 (100%) 


4 (100%) 


8 (100%) 


5 (100%) 


4 (100%) 


7 (100%) 


35 (100%) 



Notes: An injection was deemed successful when it could be completed by the participant without any assistance. One participant in the CG group did not have enough time to 
perform the second injection. Therefore, n-4 for the second injection in this group, and n-35 was used for the calculation of the total success rate of the second injection. 
Abbreviations: HCPs, health care professionals; CGs, caregivers; ADs, adolescents; DR, diabetics with retinopathy; DN, diabetics with neuropathy; AR, patients with arthritis. 



would agree with this statement. The combined rating for the 
two categories was 92% of all participants. Looking at the 
rating per user group, it appears that 100% of participants in 
all groups except the CG and AR groups would either agree or 
strongly agree that they felt confident in using the device. 

Overall, 28% of participants rated the UnoPen™ as very 
comfortable to use, whereas 47% rated it as comfortable to 
use, giving a combined result of 75% of participants rating 
the device as at least comfortable to use. Only 8% of the 
participants rated the UnoPen™ as uncomfortable to use, with 
the remaining 17% rating the degree of comfort as neutral. 
The results per user group are shown in Table 5. 

Table 6 presents the reported degree of usefulness of the 
IFU. Overall, 75% of the participants rated the IFU as very 
helpful and 25% as somewhat helpful bringing the total to 
100% of participants finding the IFU to varying degrees 
helpful. 

Errors and deviations 
from IFU procedure 

Table 7 presents an overview of all observed user errors 
and deviations from the procedure described in the IFU. No 
near misses were recorded. Overall, a total average of 3.35 
errors and deviations per injection were observed. However, 
a large number of the observations concerned errors and 
deviations without any potential negative impact on the 
user and of no possible consequence for the outcome of the 
injection. These observations were lumped together and 
categorized as trivial, whereas the remainder were labeled 
potentially relevant. It should be noted that the potentially 
relevant errors and deviations were not directly linked with 



a negative consequence for the user, but rather actions that 
under certain circumstances could lead to a problem for the 
user (a kind of risky behavior). Only two of a total of 154 
observed potentially relevant errors led to an actual problem 
for the participant. 

As can be seen in Table 7, the fraction of trivial errors and 
deviations varied significantly across the user steps, being as 
high as 89% of the total for the first user step (attaching 
needle), but less than 5% for steps three and six (selecting 
the dose and disposing of the needle). Overall, 35% of the 
observed errors and deviations were defined as trivial. 

The split of potentially relevant errors and deviations 
across the user steps is shown in Figure 3. The largest propor- 
tion (35%) of all potentially relevant errors occurred when 
disposing of the needle (step 6), and significant proportions 
were observed when priming (step 2, 24%) and holding after 
injection (step 5, 21%). Attaching the needle (step 1, 4%), 
selecting the dose (step 3, 4%), and injecting (step 4, 12%) 
were associated with fewer observed potentially relevant 
errors or deviations. 

A breakdown of the observed potentially relevant errors 
and deviations per injection and user group is provided in 
Table 8. The error rate varied significantly between user 
groups, ranging from 3.75 errors per participant for the first 
injection in the DN group to 1.00 for the second injection 
in the CG group. The overall rate was 2.39 for the first and 
1.94 for the second injection, equivalent to an improvement 
of 1 9% between the injections. This improvement or learning 
effect also varied across the user groups, with the CG group 
showing the largest (39%) and the HCP group showing the 
lowest (1 1%) learning effect. 



Table 4 Reported degree of confidence when using the UnoPen™: number of participants who strongly agreed or agreed that they 
felt confident when using the UnoPen™, n (%) 

HCPs (n=7) CGs (n=5) ADs (n=8) DR (n=5) DN (n=4) AR (n=7) Total (n=36) 

Strongly agreed 5 2 6 3 4 5 25 (69%) 

Agreed 2 2 2 2 0 0 8 (22%) 

Combined 7(100%) 4(80%) 8(100%) 5(100%) 4(100%) 5(71%) 33 (92%) 

Note: UnoPen™; Ypsomed AG, Burgdorf, Switzerland. 

Abbreviations: HCPs, health care professionals; CGs, caregivers; ADs, adolescents; DR, diabetics with retinopathy; DN, diabetics with neuropathy; AR, patients with arthritis. 
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Table 5 Reported degree of comfort in using the UnoPen™: number of participants who rated their comfort in using the UnoPen 
as very comfortable or comfortable, n (%) 





HCPs (n=7) 


CGs (n=5) 


ADs (n=8) 


DR (n=5) 


DN (n=4) 


AR (n=7) 


Total (n=36) 


Very comfortable 

Comfortable 

Combined 


1 

3 

4 (57%) 


1 

2 

3 (60%) 


2 
5 

7 (88%) 


3 
1 

4 (100%) 


2 
1 

3 (75%) 


1 

5 

6 (86%) 


10 (28%) 
17 (47%) 
27 (75%) 



Notes: Of the nine participants who did not rate the UnoPen ™ as either very comfortable or comfortable to use, six ( 1 7%) rated the degree of comfort as neutral, whereas 
three (8%) rated it as uncomfortable. UnoPen™; Ypsomed AG, Burgdorf, Switzerland. 

Abbreviations: HCPs, health care professionals; CGs, caregivers; ADs, adolescents; DR, diabetics with retinopathy; DN, diabetics with neuropathy; AR, patients with arthritis. 



Discussion 

The overall success rate in performing injections was well 
above 90% for the first injection and 100% for the second 
injection. It is worth noting that the two participants who 
failed in performing the first injection made errors that led to 
problems not with the pen itself but with the needle: in one 
case not removing the inner needle cover when priming, and 
in the other case inserting the needle at an angle for injection 
and thereby bending the needle in the process. It is worth 
noting that this success rate was reached with the IFU as the 
only support, thus indicating that no training is required to 
reach satisfactory success rates. 

The reported degree of confidence in using the device was 
above 90% across all participants and user groups. Degrees 
below 1 00% were reported by participants in the AR and the 
CG groups. The results for the AR group may be related to the 
fact that this group had the highest fraction of users without 
any previous pen experience (five of seven participants). It 
is not known why the CG group reported low values. 

With regard to the degree of comfort experienced in using 
the UnoPen™, it is interesting to note that the HCP and CG 
groups consistently reported lower degrees of comfort than 
the impaired participants (DR, DN, and AR groups). It can 
only be speculated whether this was because the device is 
particularly well suited for impaired users, if HCPs and 
CGs are more critical than other users, or if the device was 
perceived to be less comfortable when injecting others as 
opposed to when self-injecting. 

The IFU was well appreciated by all participants with 
very little variation across user groups. Overall, a large 
number of user errors and deviations from the procedure 
described in the IFU were observed (average of 3.35 errors 



per injection). Here, it is important to keep the overall suc- 
cess rate in performing injections in mind, which means that 
only a very small minority of the observed user errors actu- 
ally led to failure. In fact, more than a third of the observa- 
tions concerned errors and deviations without any potential 
negative consequences for the injection or the user (trivial 
deviations). 

Furthermore, of the remaining two-thirds (potentially rel- 
evant deviations), about half were estimated to be due to users 
with previous pen experience sticking to their habits rather 
than not understanding or misinterpreting the instructions. 
For instance, observed errors such as not priming, not tap- 
ping the cartridge before priming, priming with the needle 
pointing downward, not holding for the required time after 
injection, or using the inner needle cover for needle disposal 
are all examples of what users acknowledged doing with their 
regular devices. Many participants thus either accidentally 
reverted to their usual behavior or intentionally decided to 
do it their way instead of following the IFU. 

It is also worth noting that the user steps involving 
attachment and disposal of the needle together accounted 
for almost 40% of the potentially relevant deviations, or an 
average of 0.87 errors per injection. This can be compared 
with the observed average of 0.39 errors per injection during 
the same user steps reported in another study on a comparable 
disposable injection pen. 21 It is not known why the observed 
rate in the present study was so much higher. However, about 
half of the deviations concerned using the inner needle cover 
for disposal, ie, an example of ingrained behavior rather than 
misunderstanding. Furthermore, these steps are essentially 
independent of the design of the pen injector, as the interface 
between pen and needle is standardized and thus by definition 



Table 6 Reported degree of usefulness of the IFU: number of participants who rated the IFU as very helpful or somewhat helpful, n (%) 





HCPs (n=7) 


CGs (n=5) 


ADs (n=8) 


DR (n=5) 


DN (n=4) 


AR (n=7) 


Total (n=36) 


Very helpful 
Somewhat helpful 
Combined 


6 
1 

7 (100%) 


4 
1 

5 (100%) 


6 
2 

8 (100%) 


3 
2 

5 (100%) 


3 
1 

4 (100%) 


5 
2 

7 (100%) 


27 (75%) 
9 (25%) 
36 (100%) 



Abbreviations: IFU, instructions for use; HCPs, health care professionals; CGs, caregivers; ADs, adolescents; DR, diabetics with retinopathy; DN, diabetics with neuropathy; 
AR, patients with arthritis. 
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Table 7 Observed user errors and deviations from the IFU: 
overview of all injections (n=7 1 ) 



User step 


Total 


Potentially 


Potentially 


Trivial 


Trivial 






relevant n 


relevant as 




as % of 








% of total 




total 


1. Attach 


63 


7 


1 1% 


56 


89% 


needle 












2. Prime 


46 


37 


80% 


9 


20% 


3. Select 


6 


6 


100% 


0 


0% 


dose 












4. Inject 


29 


18 


62% 


1 1 


38% 


5. Hold 


37 


32 


86% 


5 


14% 


6. Dispose 


57 


55 


96% 


2 


4% 


of needle 












Sum over 


238 


155 


65% 


83 


35% 


all steps 













Notes: Observed user errors and deviations from IFU procedure with no potential 
for negative impact on the user and of no possible consequence for the outcome 
of the injection were classified as trivial whereas all other errors/deviations were 
classified as potentially relevant. 
Abbreviation: IFU, instructions for use. 



the same for all pens. 24 Looking at the number of potentially 
relevant errors and deviations for the remaining user steps 
(priming, dose setting, injecting, and holding), the average 
was 1.31 errors per injection, which can be compared with 
an average of 1.36 errors per injection during the same user 
steps reported in the other study. 21 

The fact that potentially relevant deviations were 
observed during the actual injection step in 24% of the 
cases may be considered remarkable. However, of these 17 
deviations, 14 were related to participants not keeping the 
display window in view while injecting. This error deprived 
the user of visual feedback on the progress of the injection; 
however, tactile and audible feedback was still provided and 
allowed all participants committing this error to complete the 
injection successfully. 

There were large differences in the numbers of potentially 
relevant errors and deviations for all user steps observed in the 



1 1 . Attach needle (4%) 
I 2. Prime (24%) 
I 3. Select dose (4%) 
14. Inject (12%) 

5. Hold (21%) 

6. Dispose of needle (35%) 



Figure 3 Potentially relevant user errors and deviations from the IFU, split between 
user steps over all user groups and all injections (n-7l). 
Abbreviation: IFU, instructions for use. 
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different user groups. Thus, participants in the HCP and CG 
groups had averages well below two errors per injection, the 
adolescent group had around two, and the DR, DN, and AR 
groups had averages well above two and even above three in 
some cases. These observed differences correlate well with 
differences both in experience and in dexterity and visual 
acuity between the user groups. It is believed that it is the 
difference in experience rather than level of impairment that 
explains the observed differences in error rate. 

The number of potentially relevant errors and devia- 
tions was observed to decrease between the first and second 
injections in all user groups, although this decrease (learning 
effect) varied strongly between groups. That the HCP group 
showed the lowest learning effect is believed to be due to 
the majority of their errors being deliberate deviations rather 
than actual misinterpretations. The above-average learning 
effect in the AR group is presumably due to it having a large 
number of participants without any previous pen experience. 
It is not understood why the CG group exhibited such a high 
learning effect, but it is believed that it may have been an 
artifact, due to the low numbers of both errors and users for 
the second injection, which makes the rate calculation very 
sensitive to small absolute variations in numbers. 

With regard to how the results of this formative study 
impact further usability work on the UnoPen™, the general 
observation that the device can be safely and efficiently used 
by all tested user groups provides confidence that the device 
and IFU in their current form will pass future summative 
testing in specific applications. The significant differences in 
use patterns and number of errors that have been observed 
between different groups suggest that further formative 
work, possibly resulting in changes to the IFU and/or device 
design, may be useful in certain applications, eg, where user 
populations include naive and impaired patients. Depending 
on the options available for a certain application, it may be 
considered to add user training for cases where this could be 
expected to be beneficial, eg, user populations similar to the 
ones who in the current study showed above-average numbers 
of errors in combination with strong learning effects. 

Conclusion 

The UnoPen™ together with the IFU could be safely and 
efficiently used by all user groups without any training, with 
an overall success rate in performing injections above 90% 
for the first injection and 100% for the second injection, and 
a reported degree of confidence in using the device above 
90% across all participants and user groups. The IFU was 
well appreciated by 100% of the participants. 



Although a large number of user errors and deviations 
from the procedure described in the IFU were observed, more 
than a third of the observations concerned errors and devia- 
tions without any risk of negative user consequences, and 
another quarter were associated with use of the needle rather 
than the pen injector itself. A noticeable fraction of errors 
and deviations were also due to experienced users sticking 
to their (erroneous) habits rather than not understanding or 
misinterpreting the instructions. 

Little variation was observed between the different user 
groups in injection success rate, in-use confidence, and com- 
fort, as well as in perceived IFU usefulness, whereas large 
differences between the groups were seen in number of errors 
and deviations, as well as the improvement from the first to 
the second injection. The observation that the device can be 
safely and efficiently used by all tested user groups provides 
confidence that the device and IFU in their current form will 
pass future summative testing in specific applications. 
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